Reconstruction of Transparent Objects for Augmented Reality. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014): Proceedings of a meeting held 10-12 September 2014, Munich, Germany
نویسندگان
چکیده
Dealing with real transparent objects for AR is challenging due to their lack of texture and visual features as well as the drastic changes in appearance as the background, illumination and camera pose change. The few existing methods for glass object detection usually require a carefully controlled environment, specialized illumination hardware or ignore information from different viewpoints. In his work, we explore the use of a learning approach for classifying transparent objects from multiple images with the aim of both discovering such objects and building a 3D reconstruction to support convincing augmentations. We extract, classify and group small image patches using a fast graph-based segmentation and employ a probabilistic formulation for aggregating spatially consistent glass regions. We demonstrate our approach via analysis of the performance of glass region detection and example 3D reconstructions that allow virtual objects to interact with them.
منابع مشابه
IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2017 Adjunct, Nantes, France, October 9-13, 2017
متن کامل
The Technical Committee on Wearable Information Systems
Wearable computing is getting increasingly integrated in our every day life and the evolution of our community continues. In addition to the IEEE International Symposium on Wearable Computers, TC WIS co-sponsors the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR) and a few other conferences and workshops. The TC helped initiate the IEEE Computer Society’s Pervasive C...
متن کاملGuest Editor's Introduction to the Special Section on the International Symposium on Mixed and Augmented Reality 2013
THE IEEE International Symposium on Mixed and Augmented Reality (ISMAR) is the leading venue for publishing the latest Mixed and Augmented Reality research, applications and technologies. This special section presents significantly extended versions of the best papers from the IEEE ISMAR 2013 proceedings. These papers consider two enduring themes of AR research—the development of the basic tech...
متن کاملSmart Headlight: A new active augmented reality that improves how the reality appears to a human
A combination of computer vision and projector-based illumination opens the possibility for a new type of augmented reality: selectively illuminating the scene to improve or manipulate how the reality itself, rather than its display, appears to a human. One such example is the Smart Headlight being developed at Carnegie Mellon University’s Robotics Institute. The project team has been working o...
متن کاملSenseshapes: using statistical geometry for object selection in a multimodal augmented reality system - Mixed and Augmented Reality, 2003. Proceedings. The Second IEEE and ACM International Symposium on
We introduce a set of statistical geometric tools designed to identify the objects being manipulated through speech and gesture in a multimodal augmented reality system. SenseShapes are volumetric regions of interest that can be attached to parts of the user’s body to provide valuable information about the user’s interaction with objects. To assist in object selection, we generate a rich set of...
متن کامل